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ABSTRACT 

Objectives: To examine reductions in suicidal ideation 
among a sample of patients who were prescribed an 
internet cognitive behavior therapy (iCBT) course for 
depression. 

Design: Effectiveness study within a quality assurance 
framework. 

Setting: Primary care. 

Participants: 299 patients who were prescribed an iCBT 
course for depression by primary care clinicians. 
Intervention: Six lesson, fully automated cognitive behaviour 
therapy course delivered over the internet. Primary outcome: 
suicidal ideation as measured by question 9 on the Patient 
Health Questionnaire (PHQ-9). 
Results: Suicidal ideation was common (54%) among 
primary care patients prescribed iCBT treatment for 
depression but dropped to 30% post-treatment despite 
minimal clinician contact and the absence of an intervention 
focused on suicidal ideation. This reduction in suicidal 
ideation was evident regardless of sex and age. 
Conclusions: The findings do not support the exclusion of 
patients with significant suicidal ideation. 
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Patients who say they feel they would be 
'better off dead' worry clinicians and, for 
that matter, research ethics committees 
approving depression trials, especially trials 
over the internet. As a consequence, patients 
reporting suicidal ideas are often excluded 
from internet treatment trials. 1-3 Given that 
suicidal thoughts are an integral part of 
depression we sought data to provide a 
rational basis for inclusion/ exclusion of 
people with suicidal ideas. 

Rates of suicide can be reduced through 
treatment of depression or reduction in 
access to the means for suicide. 4-6 The effi- 
cacy of cognitive behavioural therapy (CBT) 
in treating depression has been established. 
Suicidal ideas and attempts decrease, com- 
mensurate with reductions in depressive 
symptomatology. 7-15 These studies have all 
been conducted within a clinical trial frame- 
work among depressed patients selected for 
their high suicide risk. To our knowledge, 



ARTICLE SUMMARY 



Article focus 

■ The reduction of suicidal ideation among patients 
treated for depression using internet cognitive 
behaviour therapy (iCBT) in clinical practice. 

Key messages 

■ Suicidal ideation is common among primary care 
patients prescribed iCBT for depression. 

■ After treatment with iCBT, suicidal ideation 
decreased significantly. 

■ The continued exclusion of these patients from 
research studies and iCBT is no longer justified. 

Strengths and limitations of this study 

■ Evidence is needed to see if the changes in sui- 
cidal ideation are sustained over time. 



there is currendy no evidence regarding the 
effectiveness of CBT or internet CBT (iCBT) 
in reducing suicidal ideation in the depressed 
patient seeking treatment in primary care, 
and no data to inform inclusion/exclusion 
criteria in clinical trials. 

We have previously reported from two ran- 
domised controlled trials that the progress of 
patients receiving the iCBT course used in 
this study was significantly better than the 
progress of a waitlist control group. 1 2 We 
have also reported from quality assurance 
studies that when these courses were used 
routinely by primary care clinicians that 
effectiveness was comparable to the efficacy 
and that adherence rates of 60% could be 
achieved. 16 17 The aim of the current quality 
assurance study is to examine reductions in 
suicidal ideation among a sample of patients 
who were prescribed an iCBT course for 
depression by primary care clinicians. 



METHOD 
Sample 

Primary care physicians prescribed the inter- 
net depression course for patients they 
deemed suitable. 1 They were advised to 
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exclude people who were 'actively suicidal'. As part of a 
routine quality assurance exercise we analysed the pro- 
gress of the 299 primary care patients who completed 
the six-lesson iCBT depression course between April 
2009 and May 201 1/ Data gathered were confined to 
measures used as a routine to inform practitioners about 
the progress of their patients. All patients agreed that 
their pooled data could be used for quality assurance 
purposes. This paper was written as part of the Quality 
Assurance activities of St Vincent's Hospital with whom 
the draft of the paper was lodged prior to submission. 

Intervention 

The iCBT depression course consists of six lessons cover- 
ing psycho-education, behavioural activation, cognitive 
restructuring, problem-solving, graded exposure and 
relapse prevention. 1 2 Content is presented in the form 
of an illustrated story in which the character gains 
mastery over their depressive symptoms. At the end of 
each illustrated lesson the patient downloads 'home- 
work,' comprising a summary of the lesson content, and 
activities to be completed that translate the skills learnt 
in the lesson to their own lives. Automatic emails are 
also sent congratulating patients when they complete 
lessons. Clinicians are advised to contact patients at least 
twice during the course. 

Outcome measures 

The Patient Health Questionnaire (PHQ-9) is a brief 
nine-item measure of depression severity. 18 The nine- 
items assess Diagnostic and Statistical Manual-TV 
Criterion A for major depressive disorder (MDD). 
Patients rate each item in terms of the frequency of symp- 
toms over the past 2 weeks, on a four-point scale (0=not 
at all, l=several days, 2=more than half of the days and 
3=nearly everyday) . Scores can range from 0 to 27, with 
higher levels representing higher symptom severity. 
Cut points for MDD have been established as follows: 
0— 9=well or subthreshold, 10-14=mild, 15-19=moderate 
and 20-27=severe depression. 19 . Suicidal ideation was 
measured by question 9 from the PHQ-9 which asks 
about the frequency of suicidal ideation ('thoughts that 
you would be better off dead, or of hurting yourself in 
some way') in the previous 2 weeks using the above four- 
point scale. The PHQ-9 has been shown to demonstrate 
adequate reliability, convergent/ discriminant validity and 
responsiveness to change in previous studies of iCBT, 
with a Cronbach's a of 0.89 in the current sample. 
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Statistical analysis 

Changes in participants' PHQ9 scores from pre- 
treatment to post-treatment were analysed using a paired 
samples t test. Multivariate linear regression controlling 
for baseline PHQ-9 scores was used to investigate the 
effect of sex and age on post-treatment PHQ-9 scores. A 
Wilcoxon signed-rank test was used to analyse differ- 
ences in suicidal ideation in response to treatment. 
Multinomial logistic regression controlling for baseline 



suicidality investigated the effect of sex and age on post- 
treatment suicidal ideation. An a of 0.05 was used to test 
statistical significance. 

RESULTS 

Baseline characteristics 

The mean age of the 299 patients who completed the 
six lesson course was 43 years, 56% female. The mean 
baseline PHQ-9 score was 14.3 with 83 patients scoring 
0-9 (well or subthreshold MDD), and 216 scoring 10-27 
and likely to meet criteria for MDD (n=72 mild, n=70 
moderate and n=74 severe MDD). Prior to the start of 
lesson 1, 54% of the patients (162/299) reported some 
level of suicidal ideation on question 9 of the PHQ-9: 
30% (91/299) had thought about it for several days in 
the past 2 weeks, 15% (45/299) thought about it more 
than half the days and 9% (26/299) indicated that they 
thought about suicide nearly everyday. 

Post-treatment outcomes 

From pre-treatment to post-treatment there was a signifi- 
cant reduction in PHQ-9 scores (t(298)=18.1, p<0.001), 
with PHQ-9 scores reducing by 6.2 points on average 
(SD=5.9; d=0.98 (95% CI)). A multivariate linear regres- 
sion controlling for baseline PHQ-9 scores indicated 
that age and gender were not statistically significant pre- 
dictors of post-treatment PHQ-9 scores. The reduction 
in suicidal ideation was considerable and evident at 
all frequencies, with only 30% (90/299) reporting 
suicidal ideation at lesson six (see figure 1). AWilcoxin 
signed-rank test showed a statistically significant change 
in suicidal ideation (Z=— 7.9, p<0.001, r=0.5) as mea- 
sured by question 9 on the PHQ-9 (table 1), with 
median scores of 1 ('several days') preintervention and 
0 ('not at all') postintervention. A multinomial logistic 
regression controlling for baseline suicidal ideation 
scores indicated that age and gender were not statistic- 
ally significant predictors of postintervention suicidal 
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Figure 1 Frequency of suicidal thoughts (number of 
patients) before and after treatment for depression. 
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Table 1 Frequency of suicidal thoughts as measured by Question 9 of the PHQ-9 





Not at all 


Several days 


More than half the days 


Nearly every day 


Preintervention 


137 (45.8%) 


91 (30.4%) 


45 (15.15%) 


26 (8.7%) 


Postintervention 


209 (69.9%) 


66 (22.1%) 


14 (4.7%) 


10 (3.3%) 



PHQ-9, Patient Health Questionnaire. 



ideation scores. Patient reported a median of 1 (range 
0-2) clinician contacts during the course (table 1). 

DISCUSSION 

Suicidal ideation was common (54%) among primary 
care patients prescribed treatment for depression but 
dropped to 30% post-treatment despite minimal clinician 
contact and the absence of an intervention focused on 
suicidal ideation. This reduction in suicidal ideation was 
evident regardless of sex and age. To our knowledge, this 
is the first study to document an association between 
iCBT for depression and reductions in suicidal ideation. 

The benefits in reducing suicidal ideas are clear. Suicidal 
behaviour lies on a continuum from thoughts, through 
intent and planning, to attempt. In the general population 
it has been shown that 34% of people with ideas develop 
suicidal plans, and that these plans lead to suicide attempts 
in 72% of cases. 15 21 That is, one in four people who report 
suicidal ideation will transition to a suicide attempt, most 
within the first year of ideation onset. 21 Suicide attempts 
are significant predictors of subsequent completed suicide. 
Suicidal ideas are distressing and dangerous, and therefore 
an important target for treatment 

We have conducted two randomised controlled trials 
of our iCBT programme for depression. 1 2 In the first 
trial, 33% of applicants were excluded due to suicidal 
ideation. In the second, 23% were excluded due to sui- 
cidal ideation. On the basis of the current results it is 
now difficult to justify excluding patients from clinical 
trials on the basis of their high suicidal ideation scores 
when iCBT can reduce them quickly and effectively. 

Limitations 

Although the item from the PHQ-9 assessed the pres- 
ence and frequency of suicidal ideation, it did not assess 
the intensity of the ideation, controllability, intention to 
act on thoughts, nor suicide plans or means. Evidence is 
also needed to understand whether the changes in sui- 
cidal ideation observed in this study are sustained over 
time. In addition, there was no control sample, meaning 
that treatment effects could be attributable to regression 
to the mean, spontaneous remission or placebo effects, 
rather than the intervention per se. The fact that bene- 
fits were observed among patients at different levels of 
baseline risk indicates that regression to the mean may 
not underlie treatment effects. However, it is not pos- 
sible to fully examine the influence of these alternative 
factors on the outcomes of interest. It was also not pos- 
sible to establish whether treatment effects were 
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sustained over time due to the lack of follow-up data. 
Finally, the lack of formal exclusion criteria means that 
patients may have been using adjunctive treatments 
which contributed to the magnitude of treatment 
effects. While the limitations outlined above may be crit- 
ical within the context of an efficacy trial, they are 
endemic to effectiveness research. 

Conclusion 

Both suicidal ideation and depressive symptomatology 
were reduced considerably following completion of a six- 
lesson iCBT course for depression. This is the first study 
to demonstrate this association in primary care. At 
present, it is routine to exclude patients with frequent 
suicidal ideation from participating in iCBT This study 
provides evidence for change. 
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